Amendments to the Claims : 



1 . (CURRENTLY AMENDED) A system for executing a 
multimodal software application, comprising: 

a first set of peripheral devices for receiving inputs from a user in a 
plurality of modalities and a second set of peripheral devices for 
generating outputs to a user in a plurality of modalities; 

the multimodal software application, wherein said multimodal 
software application i s configured to receives first data .that is reflective of 
an input Jrom [[a]] the first set of peripheral devices and outputs second 
data .to form an output, to a second set of peripheral devices; 

a dialog engine in communication with the multimodal software 
application, wherein said dialog engine i s conf i gured to executes a 
workflow description .having a plurality of dialog units that form a dialog. 
received from the multimodal software application and provides the first 
data to the multimodal software application; 

the dialog engine selectively enabling the modality of the input from 
the first set of peripheral devices based on a state of the dialog of the 
workflow description; 

said dialog engine further conf i gured to controlling outputting of a 
prompt from the workflow description based on an input state of the 
enabled modality of the first set of peripheral devices; and 

a respective interface component associated with each peripheral 
device within said first and second sets; wherein each interface 
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component is configured to provide the second data, if any, to the 
associated peripheral device and receive the first data, if any, from the 
associated peripheral device. 

2. (CURRENTLY AMENDED) The system according to claim 1 , 
wherein said control of the outputtinq includes interrupting the prompt if 
the first data is received while the prompt is being output. 

3. (CURRENTLY AMENDED) The system according to claim 1 , 
wherein said control of the outputtinq includes delaying outputting of the 
prompt if one of the first set of peripheral devices is receiving an input and 
the first data. 

4. (CURRENTLY AMENDED) The system according to claim 1 , 
wherein said control of the outputtinq includes determining that the first 
data relates to the prompt and a subsequent prompt, and associating a 
portion of the first data with the prompt and associating another portion of 
the first data with the subsequent prompt. 

5. (CURRENTLY AMENDED) The system according to claim 4, 
wherein said control of the outputtinq further includes avoiding the output 
of the subsequent prompt. 
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6. (CURRENTLY AMENDED) The system according to claim 2, 
wherein said control of the outputtinq further includes preventing 
interrupting and term i nat i ng the prompt if the prompt is designated as non- 
interruptible. 

7. (CURRENTLY AMENDED) The system according to claim 1 , 
wherein the first set of peripheral devices includes one or more of a voice 
speech recognition system, a radio-frequency identifier scanner, a bar 
code scanner, a touch screen, a keypad, and a computer. 

8. (ORIGINAL) The system according to claim 1 , wherein the second 
set of peripheral devices includes one or more of a voice synthesis 
system, a display screen and a computer. 

9. (CURRENTLY AMENDED) A method for executing a 
multimodal application, comprising the steps of: 

executing a workflow description received from the multimodal 
application, said workflow description including a plurality of workf l ow 
objects dialog units that form a dialog ; 

receiving inputs from a user in at least one modality from at least 
one peripheral device of a plurality of peripheral devices and generating 
outputs to a user in at least one modality with at least one peripheral 
device from another plurality of peripheral devices; 
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outputting a prompt of a first workflow object via a peripheral device 
of the another plurality of peripheral devices, said prompt related to the 
multimodal application; 

selectively enabling a modality of the input from the plurality of 
peripheral devices based on a state of the dialog of the workflow 
description; and 

controlling the outputting of the prompt according to an input state 
of the enabled modality from the plurality of peripheral devices. 

1 0. (CURRENTLY AMENDED) The method according to claim 9, 
wherein the prompt relates to a visual control of a GLU graphical user 
interface screen of the multimodal application. 

1 1 . (CURRENTLY AMENDED) The method according to claim 9, 
wherein the step of controlling includes the steps of: 

receiving an input data before said step of outputting completes; 

and 

in response to receiving the input data, terminating the outputting 
step whereby any remaining portion of the prompt is not output. 
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1 2. (ORIGINAL) The method according to claim 1 1 , wherein: 

the step of outputting includes outputting an audio prompt; and 
the step of receiving includes receiving voice data from a speech 
recognition system. 

13. (CANCELLED) 

14. (ORIGINAL) The method according to claim 1 1 further comprising 
the steps of: 

determining if the prompt has been designated as non-interruptible; 

and 

preventing terminating of the prompt. 

1 5. (ORIGINAL) The method according to claim 1 1 , further comprising 
the steps of: 

performing the step of terminating if the data is received from a 
predetermined peripheral device; and 

omitting the step of terminating if the input is received from other 
than the predetermined device. 
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1 6. (CURRENTLY AMENDED) The method according to claim 
9, wherein the step of controlling includes the steps of: 

receiving an input data, in response to the prompt, related to the 
prompt and a second workflow object; and 

associating a portion of the input data with the first workflow object 
and another portion of the input data with the second workflow object. 

17. (ORIGINAL) The method according to claim 16, further comprising 
the step of: 

preventing output of a subsequent prompt related to the second 
workflow object. 

1 8. (CURRENTLY AMENDED) The method according to claim 
1 6, wherein the input data relates to the first workflow object and a 
plurality of other workflow objects. 

1 9. (CURRENTLY AMENDED) The method according to claim 9, 
wherein the step of controlling includes the steps of: 

receiving an input data at one of the plurality of peripheral devices; 

and 

delaying the step of outputting the prompt until the input data is no 
longer being received. 
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20. (CURRENTLY AMENDED) The method according to claim 
1 9, wherein the step of delaying includes the steps of: 

delaying outputting the prompt to the one of the another plurality of 
peripheral devices; and 

permitting outputting the prompt without delay to another of the 
another plurality of peripheral devices. 

21 . (CURRENTLY AMENDED) The method according to claim 
19, further comprising the steps of: 

determining if the input data relates to the prompt; and 
omitting outputting of the prompt if the input data relates to the 
prompt. 

22. (CURRENTLY AMENDED) A tangible computer-readable 
storage medium bearing instructions encoded thereon for executing a 
multimodal application, said instructions being arranged, upon execution 
thereof, to cause one or more processors to perform the steps of: 

executing a workflow description received from the multimodal 
application, said workflow description including a plurality of workf l ow 
objects dialog units that form a dialog ; 

receiving inputs from a user in at least one modality from at least 
one peripheral device of a plurality of peripheral devices and generating 
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outputs to a user in at least one modality with at least one peripheral 
device from another plurality of peripheral devices; 

outputting a prompt of a first workflow object via a peripheral device 
of the another plurality of peripheral devices, said prompt related to a 
visual control of a GUf graphical user interface screen of the multimodal 
application; 

selectively enabling a modality of the input from the plurality of 
peripheral devices based on a state of the dialog of the workflow 
description; and 

controlling the outputting of the prompt according to an input state 
of the enabled modality from the plurality of peripheral devices. 

23. (CURRENTLY AMENDED) The computer-readable_storage 
medium according to claim 22, wherein the instructions are further 
arranged, upon execution thereof, to cause the one or more processors to 
perform the steps of: 

receiving an input data before said step of outputting completes; 

and 

in response to receiving the input data, terminating the outputting 
step whereby any remaining portion of the prompt is not output. 
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24. (CURRENTLY AMENDED) The computer-readable storage 
medium according to claim 22, wherein the instructions are further 
arranged, upon execution thereof, to cause the one or more processors to 
perform the steps of: 

receiving an input data, in response to the prompt, related to the 
prompt and a second workflow object; and 

associating a portion of the input data with the first workflow object 
and another portion of the input data with the second workflow object. 

25. (CURRENTLY AMENDED) The computer-readable storage 
medium according to claim 22, wherein the instructions are further 
arranged, upon execution thereof, to cause the one or more processors to 
perform the steps of: 

receiving an input data at one of the plurality of peripheral devices; 

and 

delaying the step of outputting the prompt until the input data is no 
longer being received. 
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